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A»  an  approximation  to  tha  problaa  of  datanalnlng  tha  Maxima 

of  J(y)  -  ,/  l(x,y)dt,  ahara  x  and  y  ara  connactad  by  oartaln 
o  \ 

ralatlona,  wa  matconaldar  tha  quaatlon  of  data mining  tha 

\  If  T 

maxima  of  J(  f  y  -  I  F(x(k),  y(k))f  ahara  x(k)  9  x(  r  ), 

\  J  k-0  " 

y(k)  -  y(  {2  ).  Jn  thla  papar  jpa  conaldarsltha  convarganca  of 

"  I 

tha  dlacrata  aua  aa  N — kx>  ,  lndapandantly  of  tha  contlnuoua 
procaaa.  Convarganca  la  aatabllahad,  ualng  tha  functional 
aquation  tachnlqua  of  tha  thaory  of  dynamic  programing,  undar 
aaakar  condltlona  than  thoaa  raqulrad  by  tha  olaaalcal  oalculua 


of  varlatlona. 
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FUNCTIONAL  EQUATIONS  IN  THE  THEORY  OP 
DYNAMIC  PROGRAMMING— VI 
A  DIRECT  CONVERGENCE  PROOP 

By 

Richard  Bellman 


bl .  Introduction 

A  class  of  variational  problems  arising  fre;uently  In 
both  theory  and  application  involve  the  maximization  of  a 
functional  of  the  form 

T 

U)  J(y)  -  /  P(x.y)dt, 

o 

subject  to  relations  of  the  form 

(2)  (a)  jjy  •  G(x,y),  x(o)  •  c, 

(fc)  f^j(x,y)  5*0,  ^  "  1  *  ^  *  •••»  A* 

Here  x  and  c  are  N— dimenalona 1  vectors,  while  y  is  an 
H-dlmenalonal  vector  function.  The  maximization  is  over  y. 

Since  solutions  of  problems  of  this  type  are  only  in  rare 
instances  obtainable  in  explicit  form,  recourse  must  be  had 
to  some  type  of  approximate  solution  if  we  are  interested 
in  numerical  results.  A  method  going  back  to  Euler  constats 
of  approximating  to  the  Integral  in  (l)  by  a  sum  of  the  form 

n 

(3)  J  » (y )  -  £  AP(x ( k) ,  y  (k) ) , 

k-C 

and  to  the  relatione  in  (?)  by  the  relations 
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(a)  x(k+l)-x(k)+AO(x(k) ,y (k) ) ,x(0)-e ,k-0,l , . .  .,n. 


(b)  R1(x(k),y(k))^0, 

where 


(a)  A  •  ?/n, 

(b)  x (k )  *  x ( kT/n ) ,  y(k)  -  y(kT/n). 


Under  various  assumptions  concerning  the  function#  ?, 
G  and  R,  It  can  be  shown  that 


(6) 

or 


11m  Max  J  t  (y )  -  Max  J(y), 
r>— *x>  yy)  y 


(7)  11m  Max  Jt(y)  -  Sup  J(y). 

n — kd  {'ji  y 


Here  the  maximization  on  the  left-hand  side  la  over  all 
(n  ♦  1  }-dlmenslonal  sequences  [y(Q),  y(l),  .  .  .  ,y(W)]  . 


a 


An  essential  feature  of  the  previous  proofs  of  results 
of  this  nature  Is  the  use  of  the  formulation  of  the  oontlnuous 
variational  process  and  the  existence  of  a  solution.  A  proof 
of  this  type  requires  relatively  strong  sssusiptions  concerning 
the  benavlor  of  K  and  G.  In  this  paper  we  wish  to  bsgln  the 
study  of  convergence  proofs  which  are  Independent  of  the  continuous 
version,  and  depend  only  upon  the  discrete  version. 

We  are  Interested  in  Imposing  relatively  weak  conditions 
upon  the  functions  P(x,y)  and  G(x,y)  which  will  permit  us  to 
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conclude  that  the  Halt 

(d)  11m  Hax  Jt(y)  •  J, 

n — tCD  iy  f 

exlete  as  n — *a>  through  tome  sequence  ol  integers.  It  Is 
probably  true  that  this  Halt  Mill  not  exist  under  the  sole 
assumption  of  continuity  of  P  and  0,  together  with  some  slaple 
constraint  such  as  the  uniform  boundedness  of  y ,  although  we 
know  of  no  example  of  this.  We  find  It  necessary  to  Impose 
Llpschlts  conditions  of  the  form  |P(x,y)  -  P(z,y)|  £  ki|x  -  z|a 

p 

for  all  admissible  y,  where  a  ♦  a  >  1 .  Again  we  do  not  know 
whether  this  result  is  best  possible. 

Apart  from  the  fact  that  the  convergence  of  the  above 
expression  can  be  established  by  the  methods  we  present  below 
under  lighter  conditions  than  are  Imposed  in  the  classical 
calculus  of  variations,  the  interest  in  these  results  lies  In 
the  fact  that  the  techniques  we  employ  mpen  a  path  to  a  similar 
treatment  of  other  types  of  variational  problems. 

As  we  shall  see  in  subsequent  papers,  eigenvalue  problems 
of  one— dimensional  and  multi-dimensional  type,  as  well  as  aulti- 
dimensional  variational  problems  of  other  types,  may  be  treated 
by  these  metnods  . 

Furthermore,  multi-stage  games  of  continuous  type,  such 
as  pursuit  games,  may  also  be  discussed  in  tnis  fashion, 
cf.  [2).  Here  tnere  is  no  classical  theory  to  guide  our 
analysis,  not  even  a  rigorous  formulation  of  the  continuous 
process,  nor  even  the  concept  of  s  solution. 
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In  what  follows,  ws  shall  rsly  upon  ths  functional  aquation 
approach  of  ths  theory  of  dynajslc  progressing,  [lj,  applied 
to  ths  discrete  maximization  problem.  The  results  of  this  paper 
are  self-contained,  and  require  no  previous  knowledge  of  either 
variational  theory  or  dynamic  programsing. 

Finally,  let  us  note  In  passing,  that  the  method  used 
affords  a  new  approach  to  the  computational  solution  of  varia¬ 
tional  problems,  and  a  new  approach  to  the  determination  of 
analytic  properties  of  the  solution  such  as  monotonlclty, 
concavity,  and  so  on. 

§2 .  Functional  Equations 

In  the  section  following  this,  we  shall  discuss  various 
conditions  which  we  can  Impose  upon  F,  0  and  R  In  order  to 
ensure  the  existence  of  a  maximum  In  the  discrete  version. 

In  this  section  let  us  proceed  upon  the  assumption  that  ths 
maximum  Is  attained,  and  derive  the  recurrence  relations  we 
shall  employ  to  establish  convergence. 

It  Is  clear  to  begin  with  that  the  maximum  of  Ji(y), 
as  defined  by  (1.3),  will  be  a  function  only  of  c  and  n.  Let 
us  keep  A  fixed,  equal  to  T/n,  and  define,  for  k  -  0,  1,  2,  . ..,  n, 
the  sequence  of  functions 

k 

(i)  r  (c )  -  n**  f  a  i  p(x(j),»(j))L 

■yl  J-0 

where  x(j)  and  y(j)  are  subject  the  relations 
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(2)  (a)  x(j+l)-x(j  )+AG(x  (j),y(j))»x(0)-c,j-0,l,2,...,k, 

(b)  R± (x(j) ,y(j) )^0,  k-l,2,...,K, 

and  the  maximization  la  now  over  tha  finite  aat  of  vectors 

[y  (°)  #y  (i )  #  •  •  •  »yU)J  • 

Let  ua  now  consider  this  maximization  problem  as  an  n-stage 
decision  process,  with  tha  state  variables  c  and  k.  Employing 
tha  principle  of  optimality,  cf.  [l] ,  It  la  easy  to  derive 
tha  recurrence  relations 

(3)  f.  ,(c)-Max  [A?(c,y(0) )*f  (c+A0(c,y(0))]  , 

* 1  y(o)  * 

with 

(4)  f0(c)  -Max  AF(c,y(0)). 

0  y(o) 

Tha  vector  y(0)  la  to  be  chosen  In  each  case  subject  to 
tha  constraints 

(5)  Vc'y(0))  $  0f  1  -  1,  2,  ...,  K. 

Tha  remainder  of  tha  convergence  proof  will  be  based  upon 
this  recurrence  relation  without  further  reference  to  Its  source. 

Conditions  Upon  P,  0  and  R 

Since  the  method  we  shall  employ  Is  Independent  of  the 
dimensions  of  the  vectors  x  and  y,  there  Is  no  loss  of 
generality  In  taking  x  and  y  to  be  scalar  ;uantltles.  This 
will  allow  us  to  substitute  the  usual  absolute  value  notation 


FT64 


for  the  more  distracting  non  notation. 

Wo  shall  as bubo  that  F(x,y)  and  Q(x,y)  aro  continuous 
functions  Jointly  In  tho  variables  x  and  y  In  sobs  bounded 
region  of  the  (x,y)-plane.  Furthermore,  in  order  to  ensure 
that  x(k)  doss  not  increase  too  rapidly,  we  shall  impose  a 
constraint  of  the  form 

(1)  [a(x.y)l  £  a(y)  \x  I  ♦  b(y ) , 
upon  Q(x,y ) . 

The  point  of  greatest  interest  .  t  the  type  of  constraint 
to  be  Imposed  upon  y.  If  we  reaove  all  constraints  of  the 
form  R^tx.y)  <  0,  we  are  in  the  realm  of  classical  theory. 

If  we  Impose  constraints  sueh  as 

(2)  —od  <Bi<y^m«<G0, 
or 

(3)  0  i  y  $  x» 

a  constraint  which  occurs  naturally  In  various  classes  of  multi¬ 
stage  allocation  processes,  we  enter  a  region  where  relatively 
little  has  been  done  In  the  classical  theory  apart  from  the 
establishment  of  various  types  of  existence  and  uniqueness 
theorems.  Since  there  are  greater  analytic  difficulties  in 
the  way  of  analytic  solutions  In  the  case  where  constraints  are 
present,  which  means  a  greater  dependence  upon  nuaerloal  techniques, 
we  shall  concentrate  upon  this  case. 
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If  we  set  y  »  vx,  we  see  that  (3)  becomes 

(4)  0  £  v  £  1, 

a  constraint  of  the  type  given  In  (2). 

Finally  we  have  to  impose  some  conditions  on  the  modulus 
of  continuity  of  the  functions  F(x,y)  and  G(x,y).  The  simplest 
is  a  uniform  Llpschltz  condition  of  the  type 

(5)  |F(x»,y)  -  P(x»,y)|  £  k|xi  —  xa|a, 

for  some  k  >  0  and  a  satisfying  0  <  a  <  1,  for  all  y  satisfying 
(2)  and  X|,  xa  lying  In  some  fixed  Interval  £c,c].  For  our 
convergence  proof  we  shall  Impose  a  further  condition  upon  a, 
given  beloM  In  (l)  of  $4. 

^4 .  Statement  of  the  Principal  Result 

The  main  result  ms  shall  establish  Is 

Theorem.  Assume  that 

(l)  (a)  y  satisfies  a  constraint  — cd<  mi  <  y  <  m*  <  oo  . 

(b)  F(x,y)  and  0(x,y)  are  Jointly  continuous  In  x 
and  y  In  a  region  oT  tne  form  — c  1  <  x  <  Ci, 

m  1  £  y  n>«,  and  satisfy  (^75 )  In  Thlo~reglon , 
for  an  a  satisfying  ac  ♦  a  >  1 . 

(c)  |0(x,y)i  <  ai|x)  ♦  bj  In  this  region. 

Under  these  conditions,  the  aeauence  ifn(c)  converges  to 

a  function  f(c,T)  §s  n — *x>  through  the  sequence  of  values  \  2  ;  , 
uniformly  In  an  Interval  [-ca»ca]c[-c  i,c  1]  ,  for  T  sufficiently 


small,  dependent  upon  the  constants  appearing  above. 
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The  positive  solution  of  a^  ♦  i  -  1  is  i  -  (-1  ♦/5)/2  •  .62. 
05  •  A  Lemma 

We  shall  repeatedly  use  the  following  result. 

Lemma  1.  I*t  a(c,v),  a*(c,v),  f(c,v)  and  f * ( c,v)  be  continuous 
functions  of  v  for  c  and  v  In  some  region  D.  Define 

(1)  P(c)  -  Max  [a (c , v )  ♦  f(c,v)] 

v<D 

O(c')  -  Max  [a'te'.v')  ♦  ft(c*#v')J. 
v'<D 

Then 

(2)  |P(c)-G(c • ) |^Max  [la(c , v )-a • (c • , v ' ) |  + | f  fc , v)-f • (o ' ,v) |] . 

v^D 

Proof :  Let  v  •  v(c)  be  a  value  of  v  which  yields  the  maximum 
In  the  expression  for  P(c),  and  v'  -  v  •  (c ' )  *  the  corresponding 
expression  for  v'.  Then 

(3)  F(c)  -  a (c , v )  ♦  f(c,v)  >  a(o,v')  ♦  f(c,v'), 

Ci(c')  -  a '  (c  ' ,  v 1 )  ♦  f'(c'fv')  >  a '  (c  • ,  v )  ♦  f*(c',v). 

From  these  Inequalities  we  derive  the  further  Inequalities 

(M)  P(c)  -  G(c’)  >  a(c,v‘)  -  a'CcVv’)  ♦  f(c,v*)  -  Ptc1,*') 

£  a(c,v)  -  a ' (c  * , v )  ♦  f(c,v)  -  f'(c*,v), 


from  which  we  obtain 
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(5)  |P(c)-0(c' )  I^Nax  [|a(c#T,)-*,(c'#v')l>>|f(c,v')-f'(c,,v 

|a(c,v)-a'  (c'  ,v)  J ♦  | f  (c,v)-f  •  (o',v)  |] 

This,  In  turn,  ylalda  tha  Inequality  In  (2). 

$6 .  Unifora  Llpschltz  Conditions 

We  start  out  by  assuming  that  P(x,y)  and  0(x,y)  satisfy 
Llpschltz  conditions  In  an  Interval  [-C|,C|].  Starting  with 
c  In  an  Interval  [-c»,c*]  at  the  beginning  of  an  n-stage  process 
we  see  that  after  one  stage,  we  have  an  x-velue  lying  In  the 
Interval  -c»-AMax  G(x,y)  £  x  £  c*  ♦  &Max  G(x,y),  where  the 
maximum  may  be  taken  over  the  fixed  Interval  — ct  ^  x  ^  c», 

*i  <  y  <  vi-  Continuing  In  this  way,  we  see  that  the  range 
of  x  may  Increase  with  each  stage  of  the  process.  This  Is  why 
we  must  start  In  an  Interval  [-ca,ca]c[-c  l(c  t]  ,  and  why  T 
may  be  constrained. 

Let  b  -  Max  G(x,y),  and  let  us  call  the  Interval  [— c  >  — 
tfch,  c»  ♦  bkA]  the  kth  Interval.  We  choose  T  and  &  Initially 
so  that  with  c  In  the  Initial  Interval,  the  nth  Interval  Is 
contained  In  C— c«,ca]  .  In  this  way  we  preserve  uniform  bounds. 

In  some  cases,  where  x(t)  Is  decreasing  as  a  function  of  t; 
l.e.,  where  G(x,y)  <[  0  for  all  x  and  y,  we  do  not  meet  this 
difficulty. 

It  Is  essential  for  our  proof  to  establish  a  uniform 
Llpschltz  condition  for  the  members  of  the  sequence  ifk(c)} . 
Lemma  2.  Consider  the  sequence  <fk(c)}  as  defined  by  (2.J)  and 
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(2.4),  under  the  conditions  of  the  theoren  of  $4.  For  k  • 

0,  1 ,  .  .  . ,  n,  we  have 

(1)  |fk(u)  "  f  k  (*)  I  <  mlu  -  "!*» 

for  u  and  w  In  the  n  -  k  ♦  l)8t  Interval ,  where  a  le  Independent 
of  u,  w,  k  or  A. 

Proof :  The  proof  will  proceed  by  an  Induction  on  k.  We  have 

(2)  fQ(u)  -  Wax  AP(u,y), 

y 

f  (w)  -  Max  AP(w,y'), 

0  y  ' 

wnere  y  and  y'  satisfy  the  constraints  n(  <  y,  yV  £  . 

Applying  Lean a  1,  we  obtain  the  inequality 

(3)  if0(u)  ~  f0(w)  I  $  ***  A|F(ufy)  -  F(w,y)| 

y 

£  K |u  -  w|a. 

Assume  that  we  have  denonstrated  that 

(4)  |fk(u)  ~  fk^-^  £  Kj^Ju  “ 

for  k  -  0,  1,  2,  for  u  and  w  in  the  (n  -  k  -  1)** 

Interval.  Turning  to  the  recurrence  relation  (2.3)#  and  applying 
Lemma  1,  we  obtain  the  relation 

(5)  lfk*l(u)-fk-l(")i  S  "«UlF(u.y)-?;.,y)| 

y 

♦  |fk(u+A0(u,y )  )-fk(w^d0(w,y) ) j] . 
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If  u  and  m  lie  In  the  (n  —  k  -  2)nd  Interval,  the  points 
u  f  AG(u,y),  v  ♦  AG(w,y)  will  certainly  be  Included  In  the 
(n  -  k  —  l)8t  Interval. 

(6)  |fk+1(u)  ■fk+1(")l<AKlu-wla4’Kl(^lu+^c(u»y)-»»-^o("»y)la* 

<(Kk+K)A|u-w|a*-a1KkA2|u-«|a» 

for  a  fixed  constant  at. 

This  shows  that  we  can  take  -  a*kK,  for  sone  constant 
aj  >  1.  Since  kA  <  nA  •  T,  we  see  that  we  have  a  uniform 
Llpschltz  condition. 

67 .  Stability. 

We  now  wish  to  demonstrate  a  result  concerning  the  sta¬ 
bility  of  the  sequence  (fk(c)'  under  perturbations  of  the  function 
P(x,y)  • 

Lemma  3.  Consider  the  two  frequences 

(1)  -  Max  [AP(c,v)  ♦  fR(c  +  AG(c#v))] 

Pk+1(c)  "  [^P ’  (c  ,  v )  +  Fk(c  ♦  AG ( c , v ) ) ] , 

with 

(2)  f  (c)  -  Max  AP(c,v), 

v 

PQ(c)  -  Max  AP ’ ( c , v ) . 


We  have,  under  the  hypotheses  of  the  theorem 
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(3) 


|F„(c)  -  fk(c)|  £  kA  Max  Max  |P(c,v)  -  f'(c,v)|. 


for  k  -  0,  1,  2,  . ..,  n.  The  notation  Max  signifies  that  the 

th  ck 

maximum  Is  taken  over  the  k  Interval,  at  defined  above. 

Pr^of:  Let  us  proceed  Inductively.  The  result  Is  clearly  true 
for  k  *  0.  Assume  that  we  have 


(4) 


|Fk(c)*fk(c)l  1  |F(c,v)-P* (c,v)  | , 


for  k  -  0,  1,  2,  ...»  K,  and  let  us  determine  the  form  of 
L^ ^ .  Applying  Lemma  1,  we  obtain  the  result 


(5) 


Fk+l^-fk(c)  IS"431  fc|P(c,v)-P'  (c,v)  |  +  |Pk(c+AG)— f^o-^AG)  |] 


P(«,v- 
p’Oq.v)  |] 

£(L  ♦  l)A  Max  Max  I  P(c  ,  vJ-P  •  (c  ,v)  | . 
v  ck+l 

Hence  we  may  take  L^+1  -  L^  ♦  1 . 

§8 .  Transplantation 

The  next  step  of  the  proof  depends  upon  an  Idea  which  la 
abstractly  Identical  with  one  used  by  Polya  and  Sohlffer  In 
a  similar  situation,  and  called  by  them  "transplantation".  M 

The  basic  Idea  Is  the  following.  Consider  two  multi— etage  / 

decision  processes,  having.  In  general,  distinct  optimal 
Inequalities  connecting  the  return  functions  of  the  two 
may  be  obtained  by  Interchanging  the  role  of  the  optimal 
using  each  In  the  other  process. 


policies . 


procea 


£Max  lA|P(c,v)-P,  (c,v)  l+L.  A  Max  Max  J 
V  ,  v  ck+l 
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Sometlmes,  however,  this  procedure  cannot  be  carried  out, 
alnce  an  optimal  policy  for  one  process  need  not  be  an  admissible 
policy  for  the  other.  Although  something  of  this  sort  occurs 
below,  we  can  circumvent  the  difficulty  It  causes  by  using 
an  Interesting  lemma  concerning  the  convergence  of  sequences. 

We  shall  employ  the  Idea  sketched  above  in  the  following 
way  In  order  to  compare  the  process  with  Intervals,  or  stages, 
of  length  A  with  the  corresponding  process  where  the  Interval 
Is  of  length  2A.  Consider  the  A— process  under  the  additional 
restriction  that  the  choice  of  y(2k)  must  be  the  same  as  the 
choice  of  y  (2k  1 ) .  It  Is  clear  that  the  return,  l.e.,  value 

of  the  maximum,  that  we  obtain  from  this  process  will  be  less 
than  the  return  from  the  original  A— process.  On  the  other  hand, 
the  return  from  this  process  should  be,  granted  the  principle 
of  wishful  thinking,  close  to  the  return  from  the  2A-process, 
for  A  small. 

Combining  these  results,  we  shall  obtain  an  Inequality 
connecting  the  returns  of  the  A—  and  2A— processes .  This 
Inequality  Is  strong  enough  to  yield  convergence. 

$9.  Description  of  the  A-  and  2A-process. 

Let  us  now  make  the  above  remarks  precise.  To  define  the 
2A— process ,  the  Interval  [0,T]  Is  divided  Into  equal  intervals 
of  length  2A.  Choices  of  y  are  made  at  the  points  0,  2A,  4A, 
and  so  on. 

The  A— process  Is  defined  similarly,  with  intervals  of 
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length  A .  Let  fk(eh  denote  the  sequence  of  returns  from  the 
A-procese,  as  defined  by  the  recurrence  relatione  of  (2.3) 
and  (2.4),  and  let  »gk(c)>  denote  the  sequence  of  returns  from 
the  2A— process. 

Let  us  now  define  the  following  Intermediate  process. 

The  Interval  length  le  A,  but  the  policies  are  restricted  to 
those  which  employ  the  same  y-value  at  the  points  2kA  and 
(2**1 )A.  Let  h-  (c )>  denote  the  sequence  of  returns  obtained 
in  this  way.  Then 


(1)  h  (c)  -  Max  A? (c , y ) , 

y 

h* (c  )  -  Max  [AP ( c , y )  ♦  AP(c  ♦  AO(c,y),y) 

y 

♦  ho(c  ♦  AO ( c , y )  ♦  AO (c  ♦  AO(c,y),y)], 


hpk>2(c)  -  Max  [AP  (c , y )  ♦  AP(c  ♦  AG(c,y),y) 

♦h2k (c*AG(c  ,y)*AG(c  ♦  &0(c,y),y)]. 

Here  y  le  subject  to  the  constraint  m*  <  y  <  m«. 

It  is  clear  that 

(2)  h?k(c)  <  f2k  ) *  *  -  0,  1,  2,  .. . 

Let  us  now  compare  h2k(c)  ®k^c^‘ 

It  is  easy  to  show  that  the  sequence  }h2k^c^  satisfies 
the  same  type  of  uniform  Llpschltz  condition  as  that  which  we 
derived  for  <f  (c)i.  Hence  we  may  write 
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(3)  h2k^2(c)  "  Max  L2Ap(c»y)  +  h2k^c  +  2AQ(c*y))  +  ^(c-y)]* 

where 

(4)  lE^Cc.y)  |  £  aa  Aa^1+a^ , 
since 

(5)  h2k(c+AG(c,y)+AG(c+AG(c ,y ) , y ) )-h2k (c+2AG (c ,y )+0(A1+a ) ) 

-h?k(ct2AC(c,y))*0(Aa(1,-a)). 

Applying  Lemma  5,  we  see  that 

(6)  lh2k(c)-gk(c) a*(nA)Aa^1>a)_1  <  aaT  Ab, 

where  b  -  a(l  ♦  a)  —  1  >  0. 

Combining  (2)  and  (6),  we  obtain 

(7)  f2k(c)  -  Kjj  (c  )  >  ~a*TAb 

Now  let  A— >0  through  a  sequence  A,  A/2,  A/2  , ... 

Let  the  return  from  the  kth  stage  of  the  A-process  be  ui(c),  the 

return  from  the  2kth  stage  of  the  | - process  be  ua(c),  and, 

generally,  the  return  from  the  2rkth  stage  of  the  -process 

be  u„(c ) . 
r 

Prom  the  inequality  In  (6)  we  conclude  that 

(8)  ur+l ^  £  ur(°)  ~  aaT(A/2r)b. 

To  complete  the  proof  we  require  a  result  concerning  the 
convergence  of  sequence*,  which  we  will  prove  in  the  next  section. 
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610.  A  Result  on  Convergence 

Let  ub  establish  the  following  result 

Lena a  4 .  Let  l an  (  be  a  sequence  satisfying  the  following 
conditions : 


(1)  (a)  ®  >  M  >  an  >  an  -  bn> 

(b  )  bn  >  0,  Ibn  <  ao  . 


Then  the  sequence  converges . 


Proof :  It  Is  clear  that  the  sequence  Is  uniformly  bounded  from 
below.  Let  X|  and  xa  be  two  distinct  cluster  points,  with 
uM  converging  to  x»,  and  uN  converging  to  x* .  Let  <  N|  <  H* , 
with  u^  ,  u^  close  to  xi,  and  uN^  close  to  xa .  Then,  on  one 
hand  , 


(2) 


N, 

-z 

k-M, 


ak  > 


-t, 


and  on  the  other  hand, 


(3) 


M. 

£  Hk  >  -(  . 

k-N, 


Since  t  can  be  made  arbitrarily  small,  we  nave  x»  K  xj. 

§  1 i  Conclusion  of  the  Proof 

Applying  Lemma  4,  «e  see  that  \i^[c)  converges  as  r — wd  to 
a  function  f(c,s),  where  a  -  kT/n.  Taking  n  sufficiently  large, 
we  obtain  approximations  to  a  continuous  function  of  e,  f(c,s). 


1.  Bel loan ,  R 
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